A Framework for Gesture Generation and Interpretation
نویسنده
چکیده
In this paper I describe ongoing research that seeks to provide a common framework for the generation and interpretation of spontaneous gesture in the context of speech. I present a testbed for this framework in the form of a program that generates speech, gesture, and facial expression from underlying rules specifying (a) what speech and gesture are generated on the basis of a given communicative intent, (b) how communicative intent is distributed across communicative modalities, and (c) where one can expect to find gestures with respect to the other communicative acts. Finally, I describe a system that has the capacity to interpret communicative facial, gestural, intonational, and verbal behaviors.
منابع مشابه
Introspective Study of Emotion Icon in Public Chat as a Gesture of Texting
An emotion icon, better known as emoticon is a metacommunicative pictorial representation of a facial expression that, in the absence of body language and prosody, serves to draw a receiver's attention to the tenor or temper of a sender's nominal verbal communication, changing and improving its interpretation. The present study investigates the use of these nonverbal cues in whatsapp public cha...
متن کاملRegulating Dialogue with Gestures - Towards an Empirically Grounded Simulation with Conversational Agents
Although not very well investigated, a crucial aspect of gesture use in dialogues is to regulate the organisation of the interaction. People use gestures decisively, for example to indicate that they want someone to take the turn, to 'brush away' what someone else said, or to acknowledge others' contributions. We present first insights from a corpusbased investigation of how gestures are used t...
متن کاملA Two-Level Approach for Modeling and Recognition of Hand Gesture
The main characteristics of human hand gesture can be summarized by its dynamic, multi-attribute property. Previous research for gesture pattern interpretation have shown the possibility for the recognition of local aspects of hand gesture. But global framework for finding the whole interpretation from the local aspects has yet to be provided. In this article, we proposed a two-level approach u...
متن کاملResilience-Based Framework for Distributed Generation Planning in Distribution Networks
Events with low probability and high impact, which annually cause high damages, seriously threaten the health of the distribution networks. Hence, more attention to the issue of enhancing network resilience and continuity of power supply, feels more than ever, all over the world. In modern distribution networks, because of the increasing presence of distributed generation resources, an alternat...
متن کاملconga: A Framework for Adaptive Conducting Gesture Analysis
Designing a conducting gesture analysis system for public spaces poses unique challenges. We present conga, a software framework that enables automatic recognition and interpretation of conducting gestures. conga is able to recognize multiple types of gestures with varying levels of difficulty for the user to perform, from a standard four-beat pattern, to simplified up-down conducting movements...
متن کامل